Overview
My favorite SEO Tool
The perfect tool to begin a technical analysis of any website
Screaming Frog, the Spider that Crawls Your Website
Screaming Frog is the industry standard
Seek and ye shall find... ways to improve your SEO
I Scream, You Scream, We All Scream for Screaming Frog
Screaming for Screaming Frog
Screaming Frog is fantastic!
Implementing with Screaming Frog
A perfect tool for quick website audit!
Screaming Frog SEO
You’re aren’t a “real” SEO expert if you aren’t using ScreamingFrog
Fast and accurate web crawler for SEO projects.
Big time-saver and makes technical SEO life so much easier!
Great free tool for small SEO budgets
Awards
Products that are considered exceptional by their customers based on a variety of criteria win TrustRadius awards. Learn more about the types of TrustRadius awards to make the best purchase decision. More about TrustRadius Awards
Popular Features
- Integration with web analytics tools (32)10.0100%
- Multi-domain support (28)10.0100%
- Site audit / diagnostics (50)9.696%
- Global SEO (27)9.191%
Reviewer Pros & Cons
Pricing
Paid Version
$149.00
Entry-level set up fee?
- No setup fee
Offerings
- Free Trial
- Free/Freemium Version
- Premium Consulting/Integration Services
Product Demos
Screaming Frog SEO Spider Demo
Features
SEO
Core features related to search engine optimization
- 7.4Keyword analysis(19) Ratings
The tool analyzes the content of your site to help discover the right keywords.
- 6Backlink management(22) Ratings
The tool tracks existing backlinks, measures their impact on search rankings, alerts you of new backlinks, and helps surface backlink opportunities.
- 8SERP ranking tracking(8) Ratings
The tool tracks your website’s position in search engine results pages (SERPs) for keywords, over time.
- 7Page grader(20) Ratings
The tool scores each page of your website for SEO.
- 8Competitive analysis(25) Ratings
The tool analyzes your website’s position in comparison to competitive websites in areas such as backlinks, SERP position, etc.
- 9.6Site audit / diagnostics(50) Ratings
The tool crawls your website’s pages to discover potential issues search engine crawlers might have with your website.
- 10Site recommendations(22) Ratings
The tool recommends site structure improvements and other tasks to help with SEO.
- 8Task management(8) Ratings
Users can track and manage the tasks associated with SEO.
SEO Channels
Features related to optimizing your website for specific channels
- 8.1Local SEO(16) Ratings
The tool helps optimize your website for local searches.
- 6.5Social SEO(10) Ratings
The tool tracks social mentions and backlinks and their impact on SEO.
- 8Mobile SEO(21) Ratings
The tool helps optimize your website for searches done on mobile devices.
- 9.1Global SEO(27) Ratings
The tool integrates with non-U.S.-based search engines and works in multiple languages.
SEO Platform & Account Management
Features related to scalability and integration of the SEO platform
- 10Multi-domain support(28) Ratings
For SEO agencies, the tool allows users to track multiple domains in one instance.
- 10Integration with web analytics tools(32) Ratings
The tool integrates with web analytics tools such as Google Analytics and Adobe Analytics (SiteCatalyst).
Product Details
- About
- Tech Details
What is Screaming Frog?
Screaming Frog Video
Screaming Frog Technical Details
Deployment Types | Software as a Service (SaaS), Cloud, or Web-Based |
---|---|
Operating Systems | Unspecified |
Mobile Application | No |
Comparisons
Compare with
Reviews and Ratings
(192)Community Insights
- Business Problems Solved
- Recommendations
Screaming Frog SEO Spider is a versatile tool that has become indispensable for various user needs. Users appreciate its effectiveness in auditing client and internal websites, leading to business growth and improved site performance. It allows users to schedule automatic website crawls and receive the results via email, making it easier to identify regular technical issues without manual effort. The software offers a comprehensive solution for website audits and SEO analysis, streamlining operations and improving efficiency. It assists in identifying critical errors such as broken links, duplicate pages, and missing tags, facilitating website audits on a page level. Additionally, it helps users find pages that require attention and deep crawling for e-commerce sites. The software has garnered positive feedback from users who have found it easy to use, with a wide range of functionalities. It is highly recommended for digital marketing agencies and individuals conducting website audits.
Users have made several recommendations based on their experience with the software:
- The free version of the software is sufficient for making decisions and evaluating its usefulness.
- Purchasing the software is worth the money, as it provides comprehensive crawling capabilities.
- The software is recommended for companies of any size.
- It is suggested to try out the free version before committing to the premium subscription.
- The software is a great tool for finding 404 errors and checking meta data.
- Utilize the support documentation and forums for assistance.
- The software is great for internal SEO analysis and optimization.
- Try out the free version of the software.
- The software is recommended for crawling websites and gaining insights on content and keywords.
- Do not be intimidated by the technical aspects of the software and utilize available resources for guidance.
- The software is highly recommended for its cost-effectiveness and comprehensive website crawling capabilities.
Overall, users suggest taking advantage of the support documentation and forums provided by the software for assistance with any technical aspects and guidance.
Attribute Ratings
Reviews
(1-24 of 24)My favorite SEO Tool
- Effectively and quickly assesses the scale of any problem that can be determined in the HTML source of a web site. Most sites of any age or of sufficient scale have numerous systems interacting to generate the source code. Screaming Frog's filters let you figure out where issues lie, and where they don't -- which can be key to solving for the issue.
- Screaming Frog lets you crawl your site (and others - SHHHH) as Googlebot. If Googlebot can't get everywhere you want it to go, you can fix that.
- Screaming Frog can effectively find duplicate content.
- Screaming Frog can filter for HTML, Javascript, Images, I use custom filters all the time to find little bits of code. Great for Wordpress Plugin Issues.
- It's a true SEO crawler. Reliable site-wide analytics on Metadata. You can find your canonicalization issues with this tag.
- It will build XML sitemaps for you. Good ones!
- The integrations with Lighthouse, Google Search Console, and Ahrefs!
- It's slow on slow machines.
- It's a bit of a resource hog.
- It could go even further and add some intelligence and direction to it's wonderful analytics. No reason it couldn't provide recommendations.
- I am still finding features I love on this application. You could say thats a good thing, but isn't kind of a bad thing -- i have used it so much!
There are a lot of false positives for 400 and 500 errors, basically don't go nuts over a few empty title fields, check carefully.
Screaming Frog, the Spider that Crawls Your Website
- Review Technical Elements of a Website
- Review number of URLs on a website.
- Review Pictures of a website.
- No Training is provided w/ download of tool.
- Not everyone likes the excel like format.
- The number of tabs on the top can be a bit overwhelming for first time users.
- You can easily scan any site.
- With the paid version, there is no page limit for scans.
- It provides a wide variety of information about the URL that you scan.
- Reduce the amount of system resources each scan requires.
- Create an easy way to compare multiple URLs to make competitive analysis easier.
- Improve the backlink capabilities.
Screaming for Screaming Frog
- Check status codes for a set of URLs - Simply copy and paste the URLs into the open box and within minutes you are able to see the status code, response time and potential redirects for any of the URLs. While there are online versions of this, Screaming Frog has the best copy/paste option and includes any other URL data you might need as well.
- Crawl URLs for a Custom Text - Without developing your own spider, there is no other way to do this other than visit each URL individually. This has saved us countless hours verifying proper analytics code implementation across an entire website and finding client mentions across hundreds of links.
- Finding Canonical Links - Every time Screaming Frog crawls a link or site they report back the basic information which happens to include canonical links. Again, without building your own spider or reviewing hundreds of URLs it would be a lengthy task to find all of this information.
- Customizing the crawler - It takes a little bit of playing around with the settings to understand what each of them controls and what options need to be checked or unchecked to get the right amount of information.
- Cannot Crawl a large site - Screaming Frog runs out of memory when asked to crawl a large site, even after playing around with memory settings and allocating additional memory.
Screaming Frog SEO
- It is easy to use.
- Can be integrated with Google Lighthouse
- Can be integrated with Google Search Console
- We can extract some extra information from our website.
- It is not a cloud software.
- For large websites we need to wait a lot.
Fast and accurate web crawler for SEO projects.
- Website crawling.
- Meta data extraction.
- Free version limited.
Great free tool for small SEO budgets
- Sitemap building.
- Site crawling.
- The UI is a bi confusing, especially for the uninitiated.
- Though very customizable, default settings can cause server issues due to high traffic.
Screaming Frog SEO Spider is no toad!
- A solid crawler with a lot of options.
- Allows one to see the core SEO elements of a site very quickly.
- The paid version is a bit pricey but for what it does it's worth it.
- The UX can see a bit confusing at first, but once you begin to use it the learning curve is quick.
Screaming Frog Review
- Quick crawls.
- The free version is pretty comprehensive.
- Reports able to pull in CSV format.
- Premium version could be cheaper.
- Integration with other analytics tools - Currently just GA.
- A scheduling option for the free version would be great.
A Fast and Easy Way to Explore SEO Opportunities on Any Website
- It has a reliable user interface that makes it easy and fast to scan a website.
- Reveals issues and opportunities for website optimization.
- It allows you to filter results, so you can drill down to where the problems are.
- You can export lists, so clients can either fix issues themselves or it's "proof" of what you're working on for them.
- There's a bit of jargon in terms of labeling, and with so much data available, it would be nice to have "inline" explanations of what we're looking at.
- Perhaps better graphical representations of the data, which would be helpful when explaining it to clients.
- Maybe offer recommendations for fixing issues that are found with a website?
Site audits start here
- Validates tags.
- It helps with canonicalization.
- Corrects problems with no index.
- Checks internal and external links.
- Screaming Frog runs locally. It would be nice to see a pure cloud-based version.
- It's a very complete piece of software which means it can take a while to learn.
SEO Spider — One Spider You Won't Want to Get Rid Of
As a champion for our clients, it's necessary to anticipate these changes before it becomes too late. Screaming Frog SEO Spider has made it extremely easy for us to pinpoint which URLs will need to be redirected. It completely takes the guesswork out of ensuring accuracy.
- It's simple to use. Just add in the URL you need to crawl and within minutes, it's ready to go.
- It breaks down URLs and site components by HTML, Images, etc. so you know what to look for.
- It's easily exportable so you can download the spreadsheet and get to work.
- Because there's so much information given, it's difficult for a novice user to instantly understand where to look.
- The overall UX could use some updating. Next steps aren't always super clear.
Simple and powerful crawler for websites
- You receive a report with internal structure of the website (Pages with status codes, depth structure)
- List of the pages with incorrect meta tags: meta titles & descriptions, also H1 tags
- List of the pages with insecure content and links to this content
- List with 404 errors and response codes
- List with pages where there is Google Analytics ID mismatch
- Can create sitemap with pages and images
- You can't pay per projects, only a subscription is available
- You need a lot of RAM for big websites (more then 10 millions pages)
- No cloud version
Weird name, solid SEO tool.
- Finds broken links (404 pages). Broken links hurt user experience.
- Identifies pages that include meta directives like nofollow/noindex/canonical etc. Helps understand what your pages tell crawlers to do.
- Get information about all of the internal and external links on my site (anchor text, links per page, etc). Helps in identifying key word choices and page weight.
- Requires Java. This isn't a huge deal as many computers already have it installed, but it's yet another 3rd party component.
- The free version has a crawl limit of 500 pages per site. This is fine for smaller sites, but if you're running a big e-commerce site then you'll need to pay for Pro version.
- The user interface isn't very pretty. This is an analytics tool so it doesn't really have to be, but it might be helpful for improving the overall user experience.
Screaming Frog SEO Spider is #1 for Technical SEO Analysis
- Analyzes all metadata
- Character counts of all metadata
- identifies missing alt text on all images
- identifies all H1 and H2 headlines
- identifies broken links and loops
- The GUI is a little old school
- No cloud version is available...desktop version only (Chromebooks are SOL)
- Pricing isn't terrible...but there is no monthly option. £149.00 or roughly $190USD/yr.
The best tool to have in your pocket, hands down.
- Best tool to crawl a site, hands down.
- Configurable for custom data extractions.
- In-depth exports for reporting.
- Configurable connections to Analytics and Search Console.
- Wealth of online documentation.
- Exporting one report at time to CSV or XSLX can be cumbersome and time consuming.
- Custom extraction requires pretty in-depth knowledge of RegEx or XPath.
- Not a very visual tool.
- Larges sites can take up a tremendous amount of resources (RAM, space, connection).
Screaming Frog is The Tool Every Web Dev Needs
- Quickly crawling sites with thousands of pages.
- Fantastic customer support and support portal.
- Great UI, very intuitive and not flashy.
- Great visualizations.
- Great export option which can be helpful when sending to those without access to the tool.
- Updates too frequently and is sometimes unclear on what the update is for. Since I use this on my work desktop primarily, I have to go through our help desk to update. Which turns a quick process into a much more involved, time consuming endeavor.
- An integration with a CMS (Drupal or WordPress in particular) seems like a great next step.
- Entry level technical SEO is easy to do. More advanced tools and reports can be difficult to find.
You'd be crazy not to have Screaming Frog SEO Spider as part of your SEO suite of tools!
- Finding broken links on your site - I’ve yet to use a tool that lists broken links as simply as Screaming Frog SEO Spider.
- Finding redirect loops - These are rare, but when they happen, they’re annoying and can negatively affect your SEO. Luckily, Screaming Frog points these out very simply.
- Page analysis - Some other tools are more “plain speak” than Screaming Frog SEO Spider, and some may view this as a con. I see the technical side of this tool as an extreme benefit. In my world you can have easy or you can have powerful, but it’s extremely different to have both. As it relates to page analysis, it gives you simple, technical, actionable data to make your recommended changes.
- I have 0 complaints about Screaming Frog SEO Spider. What it claims to do, it does well. It’s the industry standard for sure. I don’t say this being biased - I’ve just tried many tools to do the things that this tool does, and Screaming Frog SEO Spider is my favorite.
The first step in building an SEO program to last
- Measure and report on load time and response codes of pages.
- Custom search can identify pages missing analytics tagging.
- Export on-page SEO elements to update title tags, meta descriptions, and alt tags.
- The ability to not only crawl pages for current elements but to push updates to them would be most helpful.
Nice Complimentary Platform
- Scans pages that we may not know exist.
- Provides a great export of information that can be manipulated into a useful document.
- Provides summaries of each area for a quick look at what elements need attention first.
- Sometimes a website is large enough that you can run out of memory. There is a way to fix that in the Screaming Frog platform, however I feel like it takes a programmer to figure out and configure the crawl. I wish there was an easy button!
Good, well rounded SEO software
- Scan your entire website for missing meta data.
- Easily allowed us to identify duplicate pages on our website.
- Assisted us in finding broken links quickly and easily.
- It would be nice if the free version scanned more than 500 pages and included the crawl configuration features. Even better would be if there was a free fully functional version available for a time limited period. This would allow us to better determine if the product would meet all of our needs.
Great Crawl Tool for Any SEO Professional
- Sitemap generation
- Adhoc site crawls with particular settings. For example, crawling all URLs on a specific subdomain or with certain URL parameters
- SEO attribute verification. Say you updated a title template and want to verify across a large batch of pages.
- Verifying redirects are in place
- Since its Java based desktop software, the memory management is always clunky
- It would be great to have a cloud based option. For instance something run off Amazon's cloud services.
- Easier management of license keys when switching computers
Screaming Frog Review
In addition, we also use Screaming Frog to educate our clients on the various ways that SEO, PPC and other marketing folks can use the tool for site audits, keyword research, competitive analysis, link building and more.
- Screaming Frog does a comprehensive job of crawling our sites and returning back important things such as meta data and technical directives.
- We love testing redirects with Screaming Frog.
- We also love the outlinks report to finding internal linking opps / orphan pages.
- Screaming Frog is generally an ad hoc tool, there is no cloud functionality or monitoring like DeepCrawl has.
- Javascript crawling.
- More extensive scraper/custom export tool.
Quick, Easy, and Straight to the Point Data
- Collects all indexed HTML pages of the site. This helps for when we are redirecting old URLs to the URLs of a clients new site.
- Finds all page titles that are too long or too short and allows us to address them more quickly than waiting for a program such as Moz. It's more immediate.
- If we have duplicate meta data on pages, this program allows us to find them, sort them, export them and take care of them in a timely manner. In our business (as for many) time is money.
- Updates. When it wants you to update, you get a pop up, then when you finally agree, it takes you to the website and you have to download it all over again.. Just update!